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Mechanism for reducing data copying overhead in protected memory operating systems 



(57) A method and an apparatus for reducing data 
copying overhead associated with protected memory 
operating systems. In an ATM (Asynchronous Transfer 
Method) network, the present invention's NIC (network 
interface circuit) demultiplexes the information in the 



header of the incoming packet and routes the packet 
directly to its final destination using the present inven- 
tion's concept of targeted buffer rings. Thus, instead of 
having the packet be DMA'd to a buffer in a descriptor 
ring in the kernel, it may be routed directly to the buffer 
ring of the destination process. 
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Description 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

The present invention is related to the method and 
apparatus for data transfer into a kernel in memory. 
More specifically, the present invention is related to a 
method and an apparatus for reducing data copying 
overhead in protected memory operating systems. 

(2) Description of Related Art 

Memory as related to a computer is typically all of 
the addressable storaige space in a processing unit and 
other internal storage that is used to execute instruc- 
tions. It is well known that computer systems include 
host memory, typically a number of data buffers of an 
arbitrary byte size residing within a predetermined ad- 
dress range. These data buffers are uniquely addressed 
within the predetermined address range to allow selec- 
tive access to data for subsequent processing or trans- 
mission. Data buffers may be arranged in a circular or- 
dering as part of a buffer ring in memory. 

A protected memory operating system does not al- 
low any program to access any data memory in the com- 
puter system. Application programs are highly restricted 
in the memory they are allowed to access. When pack- 
ets arrive from a network, they are generally placed in 
a buffer which is not accessible by the destination pro- 
gram. To make the receive packet available to the des- 
tination program, it must be copied into memory which 
is accessible to the program. This copying of data rep- 
resents a great deal of the overhead in computer net- 
working. Thus, it is a great disadvantage of the prior art 
method and apparatus, that received packets are 
placed in kernel buffers which are not immediately avail- 
able to the destination process. 

Figure 1 illustrates the method and apparatus of a 
traditional approach to data access for a protected 
memory operating system. Kernel 103 has receive 
("RX") descriptor ring 1 00 with descriptors to buffers K1 , 
K2 and K3 1 02. User process A 1 05 has buffers A1 and 
A2 106. User process B 107 has buffers B1 and 82 108. 
Once a packet arrives, the router typically assigns one 
of the buffers 102 out of a free pool of buffers through 
its descriptor on kernel 103's descriptor ring 100 and 
DMA's the packet into the buffer. Once kernel 103 has 
the packet in buffer 102, the kernel determines the des- 
tination of the packet from its routing information. For 
example, the kernel may determine that the packet is 
destined for user process A 105. User process A 105 
has it's own buffers 1 06. Kernel 1 03 copies the data from 
the packet in buffer 102 byte-by-byte into user process 
A 105's buffer 106. 

Figure 2 illustrates the general steps followed by an 
exemplary implementation of the prior art method and 



apparatus. References are made to the elements illus- 
trated in Figure 1. In step 201, an incoming packet ar- 
rives. In step 202, router grabs buffer K1 through a de- 
scriptor on the descriptor ring in the kernel. In step 203. 

s router then DMA's the packet into buffer K1 . In step 204, 
the kernel decodes the packet header and determines 
that the packet is destined for user process A. In step 
205, the kernel then copies the packet data from buffer 
K1 to A1 . The incoming packet data is thus transmitted 

10 to its final destination. 

With ATM networks a packet has a Virtual Circuit 
identifier which is unique between a particular source 
and destination. The router typically looks at this VC dur- 
ing its per packet processing. A significant disadvantage 

IS of the prior art method and apparatus is that all packets 
are addressed to a single destination address, and thus 
must be DMA'd to the same buffer ring in the kernel. 

It is therefore desirable to have a method and an 
apparatus which reduces the data copying overhead as- 

20 sociated with protected memory operating systems. 
Such method and apparatus would increase overall sys- 
tem performance. 

BRIEF SUMMARY OF THE INVENTION 

25 

A method and an apparatus for reducing data cop- 
ying overhead associated with protected memory oper- 
ating systems are disclosed. In an ATM (Asynchronous 
Transfer Method) network, the present invention's NIC 

•30 (network interface circuit) demultiplexes the information 
in the header of the incoming packet and routes the 
packet directly to its final destination using the present 
invention's concept of targeted buffer rings. Thus, in- 
stead of having the packet be sent to an intermediate 

35 buffer in a descriptor ring in the kernel, it may be routed 
directly to the buffer ring of the destination process. 

In an ATM network, a packet is divided into cells. 
Each cell has an arbitrary size (for example, forty-eight 
bytes of data) and has a built in header referenced as 

40 vCl's (Virtual Channel Identifier). The VCI's typically 
have the routing information indicating the destination 
address of a packet. When a packet arrives, the router 
picks up a buffer through its corresponding descriptor 
from a pool of protected descriptors, for example, a de- 

45 scriptor ring. The router then writes the data into the buff- 
er by DMA and notifies the kernel that the packet has 
arrived. The kernel then looks up the header of the pack- 
et and tells the final destination that the packet has ar- 
rived. 

^0 Because multiple VCI's are available and the router 
is able to decode these VCI's, the router may also per- 
form the demultiplexing of the information in the header 
of a given packet. In packet switching, a VCI is a facility 
provided by a network which gives the appearance to 

55 the user of an actual connection. Packet switching is a 
process of routing and transferring data by means of ad- 
dress packets so that a channel is occupied only during 
transmission of a packet. VCI's allow physical transmis- 
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sion facilities to be shared by many users simultaneous- 
ly Typically, on connpletion of the transmission, the 
channel is made available to transfer of other packets. 

lyiore specifically, each ATM connection may have 
a private pool of buffers, into which only packets for that 
connection will be placed. Since the pool of buffers is 
private, a program can be given access to its own pool. 
No data copying will be required for packets received 
into the private pool. Therefore, a packet may be directly 
sent to its final destination by DMA. Additionally protect- 
ed buffer descriptors prevent corruption of data with the 
private buffers dedicated to the data's final destination. 
When a packet arrives, if there are no private buffers 
available, the router falls back to a common pool of buff- 
ers which are not available to the programs and thus, 
must be copied. Since not all connections will be able 
to use private buffer pools due to lack of resources, a 
change in the connection from the common pool of buff- 
ers to the private pool of buffers and vice versa is avail- 
able This change affects a connection while it operates 
The change takes effect on the next packet to arrive. 

The method and apparatus of the present invention 
therefore reduces the data copying overhead associat- 
ed with protected memory operating systems and in- 
creases overall system performance. 

ppiFF nF.qr.RIPTION QP THF DRAWINGS 



Figure 1 illustrates the method and apparatus of a 
traditional approach to data access for protected mem- 
ory operating systems. 

Figure 2 illustrates the general steps followed by an 
exemplary implementation of the prior art method and 
apparatus (references are made to elements illustrated 
in Figure 1). 

Figure 3 illustrates an exemplary computer system 
network incorporating the ATM network interface circuit 
which utilizes the method and apparatus of data access 
of the present invention. 

Figure 4 is a simplified system diagram illustrating 
the architecture of the ATM NIC of Figure 3. 

Figure 5 is a general overview of the preferred data 
structure of the host memory used for data reception. 

Figure 6 illustrates the receive RX unload, the DMA 
state and the RX load of system core illustrated in Figure 
4 

Figures 7a and 7b are flow diagrams illustrating the 
general steps followed by an exemplary implementation 
of the present invention. 

Figure 8 illustrates an exemplary format for the 
DMA state of the receive block. 

Figure 9 illustrates an exemplary application of the 
present invention of transferring incoming packets di- 
rectly to its destination. 

Figure 10 is a flow diagram illustrating the general 
steps followed by an exemplary implementation of the 
present invention as illustrated in Figure 9. 

Figure 11 illustrates an exemplary implementation 



of the present invention under an abort condition. 

Figure 12 is a flow diagram illustrating the general 
steps followed by an exemplary implementation of the 
present invention under an abort condition. 

^ OFTAILED DESCRIPTION Q F THF INVENTION 

A method and an apparatus for data transfer reduc- 
ing the data copying overhead associated with protect- 
10 ed memon/ operating systems. In an ATM (Asynchro- 
nous Transfer Method) network, the present invention s 
NIC (network interface circuit) demultiplexes the infor- 
mation in the header of the incoming packet and routes 
the packet directly to its final destination using the 
15 present invention's concept of targeted buffer rings. 

With the present invention, the software may select 
a more efficient routing of the packet to its final destina- 
tion Addressing is performed at several different levels. 
More specifically, at the ATM layerthere is a VCI in every 
20 cell header. The router used as the VCI to determine 
which targeted buffer to read or write by DMA. Inside 
the packet is another set of headers with another set of 
address, typically Internet Protocol (IP) addresses. The 
router never looks at the IP address. Since there are 
25 multiple vers coming into a host, there can be multiple 
targeted buffer rings and multiple user processes can 
receive their data with no copying. 

Thus, instead of having the packet be sent to a buff- 
er by DM A corresponding to a descriptor on the kernel's 
30 descriptor ring, the software may route the packet to a 
different buffer ring. The software may be used to des- 
ignate in advance that a particular buffer ring in the ker- 
nel points to buffers already in the final destination. 
Thus when a packet arrives, the router selects a de- 
35 scrlptor pointing to a buffer already in the packet's final 
destination, writes the data into that buffer by DMA and 
notifies the kernel that the packet has arrived. The ker- 
nel then looks up the header of the packet and tells the 
final destination that the packet is in the final destination. 
40 The method and apparatus of the present invention 
therefore reduces the data copying overhead associat- 
ed with protected memory operating systems and in- 
creases overall system performance. 

Figure 3 illustrates an exemplary computer system 
45 network incorporating a ATM network interface circuit 
(NIC) which utilizes the method and apparatus for re- 
ducing data copying overhead of the present invention. 
The computer system network 10 includes host compu- 
ter systems (not shown) which incorporate one or more 
50 of the ATM network interface circuits (NICs) 12. The 
NICs 12 are coupled to a public ATM switch 16 through 
a local ATM switch 14 to enable asynchronous transfer 
of data between host computer systems coupled to the 
network 10. Alternately, the NICs 12 can be coupled di- 
ss rectly to the public ATM switch 16. As shown in 

Figure 3. the computer system network 1 0 may also 
include computer systems which incorporate the use of 
a Local Area Network ("LAN") emulation 15 which 
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serves as a gateway for connecting other networks such 
as Ethernet or token ring networks 17 which utilize the 
ATM network as a supporting framework. 

Figure 4 is a simplified system diagram illustrating 
the architecture of the ATM NIC 1 2 of Figure 3. The ATM 
NIC 12 interfaces the host computer system coupled 
through system bus 38 to the network media 40 operat- 
ing in accordance with the ATM protocol. 

The ATM NIC 12 shown includes a System Bus in- 
terface 20, a Generic Input/Output ("GIO") interface 24, 
a System and ATM Layer Core 22. a Local Slave inter- 
face 26, an array of transmit (TX) FIFOS 28, an array of 
receive (RX) FIFOS 30, a Media interface 32, an Exter- 
nal Buffer Memory Interface 34 and clock synthesis cir- 
cuit 36. 

Together, the elements 20-36 of network interface 
ctrcu it 1 2 cooperate to asynchronously transfer data be- 
tween the host computer and the other computers in the 
network through multiple, dynamically allocated chan- 
nels in multiple bandwidth groups. Collectively the ele- 
ments of the network interface circuit 12 function as a 
multi-channel intelligent direct memory access (DMA) 
controller coupled to the System Bus 38 of the host com- 
puter system. In a preferred embodiment, multiple trans- 
mit and receive channels are serviced as virtual connec- 
tions utilizing a full duplex 155/622 Mbps physical link. 
Multiple packets of data, subscribed to different chan- 
nels over the System Bus 38 to the external buffer mem- 
ory 42, via the External Buffer Memory Interface 34, are 
segmented by the System and ATM Layer Core 22 into 
transmit cells for transmission to the Media 40 through 
Media interface 32. 

The Core 22 also comprises reassembly logic to fa- 
cilitate reassembly of the receive packets. The TX and 
RX FIFOS 28, 30, coupled between the Core 22 and the 
Media Interface 32, are used to stage the transmit and 
receive cell payloads of the transmit and receive pack- 
ets respectively. The Media Interface 32 transmits and 
receives cells to the Media 40 of the network, driven by 
clock signals provided by Clock Synthesis Circuit 36. 
Preferably the Media, and therefore the Media interface 
32, conforms to the Universal Test and Operations 
Physical Interface for ATM ("UTOPIA") standard, as pro- 
vided by the ATM Forum Ad Hoc specification. To con- 
form to the UTOPIA specification, the clock synthesis 
circuit 36 provides either a clock signal of 20 MHz or 40 
MHz to enable the Media interface 32 to support a byte 
stream at 20 MHz for 1 55 Mbps or a 16 bit stream at 40 
MHz for a 622 Mbps data stream. 

In the present embodiment, the Media Interface 32 
receives 52-byte data cells each having a 4-byte cell 
header and a 48-byte payload from the TX Fl FO 28. The 
Media Interface 32 inserts a checksum as a fifth byte to 
the cell header into each cell prior to providing the 
53-byte data cell to the Media 40. Conversely, when the 
Media Interface 32 receives cells from the Media 40, it 
examines the checksum in the fifth byte of each cell to 
determine if the checksum is correct. If so, the byte rep- 



resenting the checksum is stripped from the cell and the 
cell is forwarded to the RX FIFO 30. Otherwise, the en- 
tire cell is dropped. 

The network interface circuit 1 2 also shields the cell 

5 delineation details of asynchronous transfer from the 
applications running on the host computer system. For 
present purposes, it is assumed that applications run- 
ning on the host computer system manage transmit and 
receive data using wrap around transmit and receive 
rings with packet interfaces. However, the present in- 
vention may be practiced with the applications running 
on the host computer system managing transmit and re- 
ceive data using other data structures. 

The System Bus Interface 20 and Generic I/O inter- 

75 face 24 insulate the host computer system from the spe- 
cifics of the transfer to the Media 40. Furthermore, the 
Core 22 is insulated from the specifics of the system bus 
38 and host data structure. In the presently preferred 
embodiment, the System Bus is an S-Bus, as specified 

20 in the Institute of Electronics and Electrical Engineers 
("IEEE") standard 1496 specification. The System Bus 
Interface 20 is configured to communicate in accord- 
ance with the specifications of the system bus, in the 
present illustration, the S-Bus. 

25 It is contemplated that the System Bus Interface 20 
can be configured to conform to different host computer 
system busses. The System Bus Interface 20 is also 
configured to transfer and receive data in accordance 
with the protocols specified by the Generic I/O interface 

30 24. The Generic I/O interface 24 provides a singular in- 
terface through which the Core 22 communicates with 
the host computer Thus, the Core 22 does not change 
for different embodiments of the NIC 1 2 which interface 
to different host computer systems and busses. 

35 Host memory 50 with descriptor ring 52 and com- 
pletion ring 54 is coupled to system bus 38. Host mem- 
ory 50 may receive packets from media 40 through NIC 
12. Once the packet is in host memory 50, the software 
acknowledges the received packet and reads from de- 

■^0 scriptor ring 52. Once the software has the DMA state, 
it begins moving the data in the packet into buffer 56 
and places the DMA state back on completion ring 54. 

In a preferred embodiment, once an incoming pack- 
et with, for example, forty-eight byte cells of data and 

45 five bytes of header arrive, the router processes the 
header, looks at the VCI (Virtual Circuit) field in the cell. 
The appropriate header and VCI information including 
whether the information is target or non-target, is written 
into DMA state 64 in NIC 12. DMA state 64 in system 

50 core 22 determines whether the VCI information should 
be discarded or whether it should be tacked on to other 
cells which arrived with the VCI. Load 62 then moves 
the forty-eight bytes of data of the packet out into receive 
("RX") buffer memory 44 in external buffer memory 42. 

55 Once there is enough data in DMA state 21 to route the 
packet into the appropriate location in host memory 50, 
RX unload 60 unloads the cells from RX buffer memory 
44 in external buffer memory 42. The router then begins 
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580m may point directly to the buffer of a packet's final 
destination. Otherwise, if DMA state 64 indicates that 
the particular VCt is non-targeted^ then a buffer from the 
non-targeted (kerne!) buffer ring 581 from host memory 
50 is obtained. Once a buffer is picked up, the router 
saves the buffer information including the pointer to the 
data buffer in DMA state 64. Other information it saves 
in DMA 64 includes how large the buffer is and how 
much information has already been sent to it by DMA. 

Once it is determined where in host memory 50 the 
information is supposed to be transferred to, RX unload 
60 retrieves the cell from external buffer memory 42 and 
transmits the cell to the destination in host memory 50. 
This continues until the end of the packet arrives. The 
router then takes all the DMA state information including 
buffer pointer CRC (Cyclical Redundancy Check) and 
writes the information to completion ring 54 in host mem- 
ory 50. The router then generates an interrupt which 
wakes up the software so that the software may look at 
completion ring 54 in host memory 50 for the packet's 
DMA state information. The software may retrieve the 
packet information from completion ring 54 and is able 
to determine whether a particular packet transferred to 
host memory 50 is in a targeted buffer or whether it is 
in a non-targeted buffer The software may also con- 
clude which VCl the packet is targeted to or destined to 
and may look up the buffer table which contains the ker- 
nel address of the packet. The software then notifies the 
final destination of the packet that the packet has arrived 
at that destination. 

Figures 7a and 7b are flow diagrams illustrating the 
general steps followed by an exemplary implementation 
of the present invention. References are made to ele- 
ments in Figure 6. In step 701 , data in the form of cells 
of a packet arrives to NIC 12. The cells have a, header 
portion and the data portion. In system core 22 of NIC 
1 2, load look-ahead 74 of RX load 62 reads in the DMA 
state information of a cell including the pointer used to 
move the data of the packet cell into external buffer 
memory 42 and the CRC that is calculated so far over 
the data from the header In step 702, the DMA informa- 
tion is then stored in the registers. 

In step 703, RX load 62 instructs load data engine 
78 to move the data into external buffer memory 42. 
Once load data engine 78 moves the data, it informs 
load look-ahead 74 that it is done. If RX load 62 deter- 
mines that there is enough data in VCl 65 and that it 
should begin DMA'ing the data into host memory, RX 
load 62 writes VCl 65 into schedule queue 66 in step 
704. At this point, RX load 62 begins processing the next 
data. In step 705, once VCl 65 has been written into 
schedule queue 66, unload 60 begins its processing of 
the data. 

RX unload 60 is partitioned similarly to RX load 62. 
In step 706, RX unload 60's unload look-ahead 68 re- 
trieves VCl 65 out of schedule queue 66 and looks up 
VCl 65 in DMA state 64. In step 707, unload look-ahead 
68 then obtains the first and last cell pointers and grabs 



the CRC from DMA state 64. Unload look-ahead 68 also 
retrieves the buffer pointer in host memory if available. 
If it is the first cell of the packet that is being processed, 
there will be no buffer pointer in DMA state 64. RX un- 
5 load 60 also has a data engine 72 and get_buffer 70. In 
step 70S, if unload look-ahead 68 reads DMA state 64 
and finds that there is no buffer pointer it instructs 
get_buffer 70 to obtain one. In step 709, get_buffer state 
machine 70 looks up the targeted buffer ring pointer 
10 from DMA state 64. 

In step 710. if DMA state 64 indicates that VCl 12 
is not targeted, then VCl 12 obtains a common pointer 
for the non-targeted buffer ring 581. Get_buffer state 
machine 70 looks up this buffer ring and retrieves a buff- 
is er from the kernel in host memory 50. In step 711, if a 
VCl is supposed to be targeted, get_buffer 70 goes to 
target data descriptor ring 580a-580m and looks for a 
buffer, tf there is nothing there because the final desti- 
nation of the packet has not given the kernel any buffers, 
get_buffer 70 automatically returns to the control RAM, 
reads the non-target buffer ring and grabs a buffer from 
non-target data descriptor ring 581 and has the router 
DMA the data into that buffer In step 712, once 
get_buffer state machine 70 has a buffer it places the 
buffer back in DMA state 64. The remainder of RX un- 
load 60 is unaware of whether the buffer is targeted or 
non-targeted. 

. In step 71 3, once unload look-ahead 68 has a buff- 
er it instructs unload data engine 70 to read the data 
from external buffer memory 42 and places it in the buff- 
er pointer In the targeted case, the buffer pointer would 
be pointing to the final destination of the packet. In step 
714, the data is then sent to host memory by DMA until 
the last cell arrives. 

In step 715, when RX load 62 receives the last cell 
in the packet, it makes a notation in external buffer mem- 
ory 42 indicating that it is the last cell. This notation is 
recognized by unload data engine 72 which in turn in- 
forms unload look-ahead 68 that the cell is the last cell 
in the packet, in step 716, unload look-ahead 68 takes 
the DMA state information which it has been using for 
the whole packet and writes it to RX completion ring 54 
in host memory 50. 

In step 717, the software uses the same information 
that the router has been using to determine whether or 
not the incoming packet is a targeted buffer and whether 
a targeted buffer pointer is available for the packet. In 
this way, the kernel may recognize that the data is al- 
ready in its final destination in host memory 50 and does 
not need to be copied from the kernel to the destination 
process. In step 718, the software notifies the final des- 
tination that the packet has arrived in that destination. 

Figure 8 illustrates an exemplary format for the 
DMA state for the receive block. In a preferred embod- 
iment, each receives VCI's has eight words of state in- 
formation which in the exemplary embodiment is stored 
in RX DMA state 64. The most active VCI's state infor- 
mation may be cached on a chip. Each VCI's entry in 
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dant copying of transferred information from one area 
of the host memory to another. 

While certain exemplary embodiments have been 
described in detail and shown in the accompanying 
drawings, it is to be understood that such embodiments 
are merely illustrative of and not restrictive on the broad 
invention, and that this invention is not to be limited to 
the specific arrangements and constructions shown and 
described, since various other modifications may occur 
to those with ordinary skill in the art. 

Claims 

1. A method for reducing data copying overhead in a 
computer system including a pool of buffers, each 
said buffers associated with a protected buffer de- 
scriptor, said protected buffer descriptor preventing 
corruption of data with buffer descriptors dedicated 
to the data's final destination, said method associ- 
ated with protected memory operating systems 
comprising the steps of: 

receiving a packet to be routed to the final des- 
tination: and 

writing data of said packet to one of said buffers 
associated with the final destination. 

2. The method of claim 1 wherein said step of receiv- 
ing further comprises the steps of: 

demultiplexing information in a header portion 
of said packet to retrieve routing information for 
said packet including direct memory access in- 
formation; and 

storing said direct memory access information 
of said packet in a RX load register. 

3. The method of claim 2 further comprising the steps 
of: 

loading data of said packet into external buffer 
memory; and 

writing a virtual channel identifier of said packet 
to a schedule queue once there is enough data 
in said virtual channel identifier and said data 
may be direct memory accessed to a host 
memory. 

4. The method of claim 1 wherein said step of direct 
memory accessing further comprises the steps of: 

retrieving said virtual channel identifier from 
said schedule queue and looking up a corre- 
sponding direct memory access state; and 
retrieving said direct memory access informa- 
tion from said direct memory access state. 



5. The method of claim 4 further comprising the step 
of obtaining a buffer pointer if there is no buffer 
pointer indicated in said direct memory access in- 
formation. 

5 

6. The method of claim 4 further comprising the step 
of looking up targeted buffer pointer ring if indicated 
in said direct memory access information. 

10 7. The method of claim 6 further comprising the steps 
of: 

obtaining a common buffer if said virtual chan- 
nel identifier indicates a non-target buffer ring; 
is and 

obtaining a private buffer if said virtual channel 
identifier indicates a target buffer ring and said 
private buffer is available. 

20 8. The method of claim 7 wherein said step of obtain- 
ing a private buffer further comprises the step of ob- 
taining said common buffer if no private buffer is 
available. 

25 9. The method of claim 7 further comprising the steps 
of: 

placing said buffer in said direct memory ac- 
cess state; 

30 placing said data of said packet in said buffer 

pointer; and 

direct memory accessing said data to said host 
memory until all cells of said packet are direct 
memory accessed to said host memory. 

35 

10. The method of claim 9 further comprising the step 
of writing said direct memory access information for 
said packet into a completion ring in said host mem- 
ory. 

40 

1 1 . The method of claim 1 0 further comprising the steps 
of: 

identifying whether said packet is target or non- 
45 target from said direct memory access informa- 

tion once said data for said packet is direct 
memory accessed; and 

notifying said final destination that said packet 
has arrived. 

50 

12. An apparatus for reducing data copying overhead 
in a computer system including a pool of buffers, 
each said buffers associated with a protected buffer 
descriptor, said protected buffer descriptor prevent- 

55 ing corruption of data with buffer descriptors dedi- 
cated to the data's final destination, said apparatus 
associated with protected memory operating sys- 
tems comprising: 
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20 



a host memory having one or more target and 
non target buffers for storing data of .n^com.ng 
nackets sent to said host memory: and 

un oad mechanism coupled to said hos 
memory for sending said packet to sa.d host 
Temory, said data of said packet be.ng d.rected 
,o one of said buffers in said host memory as- 
sociated with said packet's final destination. 

13 The apparatus of claim 12 wherein said unload 
' Ichan'sm is coupled to a load -^-f^-^Z^^^, 
ing direct memory access information of said packet 
once said packet is received from an origin. 

t ,o riaim 13 wherein said unload 
^^•rchrrairadmechanismar^^^^^^^^^^^^^ 
Z a direct memory access state buffer stonng said 
direct memory access information. 
15 Theapparatusof claim 13 further comprising an ex- 
Lrnal buffer memory coupled to said unload mech- 
aTsm and said load mechanism through arj exte - 

^-:Lr:^r:o:^^^ 

sa S v'tual channel identifier being written into sa d 
sched le queue once there is enough data in said 
vlal Channel identifier and said data may be sent 

to said host memory. 

f .o riflim 12 wherein said unload 
rchrr^^tr^rmiLs an unload loo. 
Thead mechanism coupled to said direct memo y 
access^tate buffer and said schedule queue, said 
Xd look-ahead -chanism for ret^^^^^^^^ 
virtual channel Identifier from sa.d schedule queue^ 
looking up corresponding direct ^-^^^coZt 
state for retrieving said direct memory access in 
S.?mation from said direct memory access state and 

18 The apparatus of claim 12 wherein said unload 
'ZSnL further comprises a get bu«er rnec^- 
nism coupled to said direct memory access state 
buTer sJ^d get buffer mechanism for obtaining a 
bu?fe pointer if there is no buffer pointer indicated 
in said direct memory access information, for look 
ina UP targeted buffer pointer ring if indicated in sa.d 
S r^emory access information, for obtaining a 
Common buffer if said virtual channel identifier mdi- 
rarernon-targetbufferring,.orobtainingaprlvate 



buffer if said virtual channel identifier indicates a tar- 
buffer II saiav available, 
get buffer ring «;"^'^3b^„er if said direct mem- 
,or Obtaining sa^d^^^^^^^^^ ^ 

n^pTat"a::i,ab.^ 

in said direct memory access state 

. ^ nialm 18 wherein said unload 

ruTnir,,— ^^^^^^^^^^ 

ory accessed to said host memory. 

o„.cnfrlaim 19 further comprising a ker- 
^'rTarhostr^emoTyforidentifyingwhethers 

Sc^e f target or n"^ 

on/ access information once said data for said pack- 
ens sen a,a for notifying said final destina ion in 
sa id host memory that said packet has arrived. 



25 



30 



21 A system for reducing data copying overhead asso^ 
ciated With protected memory operating systems 
comprising; 

a host memoiy having one or more target and 
non-target bufiers for storing data of In-coming 
packets sent to said host memory; 
an unload mechanism coupled to said hos 
Memory for sending said packet to sad host 
memo^. said data of said packet being directed 
Ta buifer in said host memory corresponding 
: : buffer descriptor on a targeted buffer ring 
corresponding to said packet's final destina 

^processor coupled to said host memory for 
pressing said sending said packet to said 

host memory. 

22 The system Of Claim 21 wherein said unload rnech^ 
.0 anism is coupled to a load --echanism fo^ stonng 

direct memo^ access information of sad packet 
once said packet is received from an origin. 

23 The system of claim 22 wherein said unload mech^ 
45 anIsm and said load mechanism are coupled to a 

direcT memory access state buffer stonng said d,-. 
rect memory access Information. 

24 The system of claim 23 further comprising an exter- 
' ^a buffer memory coupled to said unload m cha- 
nism and said load mechanism through an external 
buffer memory interface, said external buffer mem- 
ory for storing said data of said packet. 

25 The system of claim 24 further comprising a sched- 
' uL que e coupled to said load mechanisr. and sad 
unload mechanism, said -hedu e queue fo hou^ 
ing a virtual channel identifier of said packet, 
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virtual channel identifier being written into said 
schedule queue once there is enough data in said 
virtual channel identifier and said data may be direct 
mennory accessed to said host nnemory. 

5 

26. The system of claim 21 wherein said unload mech- 
anism further comprises an unload look-ahead 
mechanism coupled to said direct memory access 
state buffer and said schedule queue, said unload 
look-ahead mechanism for retrieving said virtual io 
channel identifier from said schedule queue, look- 
ing up corresponding direct memory access state^ 

for retrieving said direct memory access information 
from said direct memory access state and writing 
said direct memory access information for said '5 
packet into a completion ring in said host memory 
after data for said packet has been direct memory 
accessed to a buffer in said host memory. . 

27. The system of claim 21 wherein said unload mech- 20 
anism further comprises a get buffer mechanism 
coupled to said direct memory access state buffer 
said get buffer mechanism for obtaining a buffer 
pointer if there is no buffer pointer indicated in said 
direct memory access information, for looking up 25 
targeted buffer pointer ring if indicated in said direct 
memory access information, for obtaining a com- 
mon buffer if said virtual channel identifier indicates 

a non-target buffer ring, for obtaining a private buff- 
er if said virtual channel identifier indicates a target 30 
buffer ring and said private buffer is available, for 
obtaining said common buffer if said direct memory 
access information indicates a target buffer but no 
private buffer is available and placing said buffer in 
said direct memory access state. 35 

28. The system of claim 27 wherein said unload mech- 
anism places said data of said packet in said buffer 
pointer and direct memory accesses said data to 
said host memory until all cells of said packet are ^0 
sent to said host memory. 

29. The system of claim 28 further comprising a kernel 
in said host memory for identifying whether said 
packet is target or non-target from said direct mem- ^5 
ory access information once said data for said pack- 
et is sent and for notifying said final destination in 
said host memory that said packet has arrived. 
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BEGIN 



A packet arrives. 



-201 



I 



Hardwsire goes to descriptor ring and grabs 
buffer Kl. 



-202 



I 



Hardware DMAs packet into buffer Kl. 



—203 



I 



Kernel decodes the packet header and 
determines packet is destined for user process 

A. 



-204 



Kernel copies data from buffer Kl to buffer Al. 



—205 




Figure 2 
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Begin 



A packet arrives from the media and to the 
system core of NIC. Load look-ahead of 
load reads in the DMA state information from 
the packet. 



—701 



The DMA information is stored in the RX load 
registers. 



-702 



Load data engine of EX load moves the data 
into the ejttemal buffer memory. 



—703 



VCI is written into schedule queue once there is 
enough data in VCI and data may be DMA d to 
host memory. 



—704 



RX vmload wakes up. 



_705 



Unload look-ahead of RX unload retrieves VCI 
from schedule queue and looks up 
corresponding DMA state. 



_706 



Unload look-ahead retrieves DMA information 
for the VCI from DMA state. 



—707 



If unload look-ahead reads DMA state and finds 
buffer pointer, then it instructs get.buffer to 
obtain one. 



—708 



no 



Get buffer looks up the targeted buffer ring 
~ pointer from the DMA state. 



-709 



Figure 7b J 



Figure 7a 
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Figure 7a 



If DMA state indicates that VCI is not targeted, 
then VCI obtains a common buffer pointer for the 
non-target buffer ring. 



— 710 



If a VCI is targeted, then get_biiffer goes to the 
target data descriptor ring and looks for a buffer. If 
the fined destination of the packet has not given the 
kernel buffers, then get_b\ifFer automatically reads 
the non- target buffer ring and grabs a non- target 
buffer. 



—711 



Get.buffer places the buffer 
in the DMA state. 



—712 



Once unload look-ahead has a buffer, it instructs 
unload data engine to read the data firom external 
memory and places the data in the buffer pointer. 



— 713 



The data is DMA'd to host memory imtil the last cell 
arrives. 



-714 



When RX load receives the last cell in the packet, it 
makes a notation to the external buffer memory and 
RX unload recognizes this notation, and knows that 
the last cell of the packet is to be processed. 



-715 



Unload look-ahead of RX imload takes the DMA 
state information for the whole packet and writes it 
to the RX completion ring in host memory. 



—716 



The software uses the seime information to 
determine whether the incoming packet is target or | — 717 
non-target. 



The software notifies the final destination of the 
packet that the packet has arrived. 



— 718 



End 
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BEGIN 



A PACKET ARRIVES FROM THE MEDIA. 



—911 



HARDWARE LOOKS AT THE VCI 
AND DETERMINES THAT IT SHOULD 
USEDESCRIPTOR RING 1 FOR THE PACKET. 
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HARDWARE DMAS PACKET 
TO BUFFER Al. 
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KERNEL DECODES PACKET HEADER AND 
^?SiNT:S that PACKET IS DESTINED 
FOR USER PROCESS A. 
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KERNEL INFORMS PROCESS A THAT 
DATA IS IN BUFFER Al. 
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BEGIN 



A PACKET ARRIVES FROM THE MEDIA. 



—Ill 



HARDWARE LOOKS AT THE VCI AND 
DETERMINES THAT IT SHOULD USE 
DESCRIPTOR RING 1 FOR THIS PACKET. 



—112 



HARDWARE FINDS NO BUFFER ON 
DESCRIPTOR RING 1 AND 
AUTOMATICALLY ABORTS TO 
DESCRIPTOR RING 2. 



-113 



HARDWARE DMAS PACKET 
TO BUFFER Kl. 



—114 



KERNEL LOOKS AT PACKET HEADER 
AND DETERMINES THAT PACKET IS 
DESTINED FOR USER PROCESS A. 



-115 



KERNEL NOTICES THAT 
DESCRIPTOR RING 1 IS EMPTY. 



—116 



KERNEL MAY ATTEMPT TO ADD MORE 
BUFFERS TO DESCRIPTOR RING 1. 
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USER PROCESS A HANDS DOWN Al AND 
KERNEL COPIES PACKET FROM Kl TO Al. 
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